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ABSTRACT 

According to the second law of thermodynamics, the arrow of time points to an ever increasing entropy of 
the Universe. However, exactly how the entropy evolves with time and what drives the growth remain largely 
unknown. Here, for the first time, we quantify the evolving entropy of cosmic structures using a large-scale 
cosmological hydrodynamical simulation. Our simulation starts from initial conditions predicted by the leading 
ACDM cosmology, self-consistently evolves the dynamics of both dark and baryonic matter, star formation, 
black hole growth and feedback processes, from the cosmic dawn to the present day. Tracing the entropy 
contributions of these distinct components in the simulation, we find a strong link between entropy growth and 
structure formation. The entropy is dominated by that of the black holes in all epochs, and its evolution follows 
the same path as that of galaxies: it increases rapidly from a low-entropy state at high redshift until z ~ 2, then 
transits to a slower growth. Our results suggest that cosmic entropy may co-evolve with cosmic structure, and 
that its growth may be driven mainly by the formation of black holes in galaxies. We predict that the entropy 
will continue to increase in the near future, but likely at a constant rate. 

Subject headings: galaxies: formation - galaxies: evolution — galaxies: halos — DM - cosmology: theory — 
entropy 



1. INTRODUCTION 

The "arrow of time" in our Universe, which has enabled 
its evolution to the present highly complex state, with large 
scale structure, galaxies, stars, and planetary systems - not 
to mention life itself - has its origin s in the extremely low- 
entrop y initial state of our cosmos (Penrose 1982; ICarrollI 
2010), and barring unforeseen calamities, will persist for 
some 10 100 years until the Universe achiev es its equilibrium 
state, aka its "heat death" (lThomsonlll852|) . Throughout this 
extremely long yet transient epoch, the probabilistic laws of 
Boltzmann's statistical mechanics assure us, the entropy of 
the Universe will be always and ever increasing, as per the 
Second Law of Thermodynamics. 

From this perspective, the formation and evolution of cos- 
mic structure, as explored via large-scale cosmological sur- 
veys and numerical simulation, must also be always consis- 
tent with the Second Law. As such, both the initial forma- 
tion and the subsequent evolution and (ultimately) dissolution 
of all the structures we observe must contribute to the ever- 
increasing entrop y of the Universe. 

Several studies dBasu & Lvnden-Bellll 19901: IFrampton et al.l 
2009; lEgan & Line weaver 2010) have explored the entropy 
budget of the present-day observable Universe. These studies 
suggested that today's total entropy is dominated by the en- 
tropy of the supermassive black holes (SMBHs) at the centers 
of galaxies. However, the detailed evolution of the entropy 
and its origin remain largely unknown. 

Over the last several decades, numerical simulation have 
been very successful on the study of the evolution of the struc- 
tures in the Universe from the time when the Universe was 
less than 1 million y ears old to the current time at 13.7 bil- 
lion years later (e.g. Sprin geTet al.l (l2005b|) ). They can also 
trace different energy forms in cosmic structures through vast 
scales, from dark matter (DM) in the large-scale structure to 
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gas and stars in the galaxies to ultra compact BHs while pro- 
ducing results that agree well with the astronomical observa- 
tions. Thus numerical simulation is an ideal tool to study the 
evolution of the entropy along the cosmic structure formation. 

In this paper, we present a quantitative study on the evolu- 
tion of entropy using high-resolution cosmological hydrody- 
namical simulation. In § 2 we describe the numerical sim- 
ulation, and the appropriate theoretical formulations for the 
entropy of different energy forms, using physical quantities 
that can be extracted directly from the simulation. In § 3, 
we present results of the formation and evolution of struc- 
tures from the simulation, the evolution of cosmic entropy, 
and the link between entropy growth and structure formation. 
We summarize in § 4 the interpretations of the results and 
their implications. 

2. METHODOLOGY 
2.1. Numerical Simulation 

Our cosmological simulation includes both dark and bary- 
onic matter and related physical processes including star for- 
mation, BH growth, and feedback. It starts from initial con- 
ditions predicted by the leading cold dark matter cosmology, 
ACDM, and follows the formation and evolution of structures 
from redshift z = 99 to the current time at z = 0. 

We performed the simulation using the parallel, N- 
body/SPH code GADGET-3, which is an im proved version 
of the widely used sim ulation code GADGET ( Springel et alJ 
l2001bUSpringell2005l) . GADGET uses the "TreePM" method 
to compute gravitational forces, which combines a "tree" 
algorithm for short-range forces and a Fourier transform 
particle-mesh method for long-range forces. It incorporates 
an entropy-conserving formulation of SPH with adaptive par- 
ticle smoothing. Radiative cooling and heating processes are 
calculated assuming collisio nal ionization equilibr i um, a nd 
the UV background model of Faucher-Giguere ^FaT] (120091) is 
used, which assumes that reionization was completed roughly 
by redshift z ~ 6. 



Star formation is modeled in a multi-pha se ISM, with a 
rate that follows the Schmidt- Kennicutt Law ( Schmidt 1959; 
lKennicuttl[T998h The model of BH grow th and feedback 
follow s that of ISpringel et all (l2005al) and iDi Matteo et~aT1 
(2005), where t he BH accre tion is calculated using a spher- 
ical Bondi rate (Bondi 1952) under the Eddington limit, and 
its feedback is in form of thermal energy, ~ 5% of the radi- 
ation, injected into surroun ding gas isot ropically. We follow 
the seeding scheme of IZhu et ail (120 1 21) and plant a seed of 
mass M B h = 10 5 h _1 M in each halo once its total mass ex- 
ceeds 10 10 h^M ^, similar to previous cosmo logical simula- 
tions with BHs (IDi Matteo et al.l I2QQ8L 120121) . Such a self- 
regulated BH model has been demonstrated to successfully 
reproduce many obse r ved properties of local galaxies (e.g. , 
IDi Matteo et all 12001 iHopkins et al.l 120061: IZhu et all l20ll 
and the most distant quasars at z ~ 6 (iLi et al. 112007b . 

The whole simulation is set up with a periodic boundary 
condition and the box size is 100 Mpc/h in comoving coordi- 
nates. The initial condition contains gas and DM components, 
each of them is represented by 512 3 particles with a gravita- 
tional softening length e = 5 kpc/h. The cosmological parame- 
ters used are Q m = 0.27, Q b = 0.045, ^ A = 0.73 and H = lOOh 
km/s/Mpc with h = 0.7, consistent w ith the seven-year results 
of the WMAP dKomatsu et al.ll20TTh . 

In order to identify structures formed on different scales, 
we use two on-the-fly group finding algorithms in the sim- 
ulation. One is the friends-of-firends (FOF) algorithm used 
to link the DM particles with particle separations less than 
0.2 times of the mean particle spacing. The gas, star and 
BH particles are then linked to the DM particle groups us- 
ing the same algorithm. The other one is the S UB FIND algo- 
rithm (ISpringel et al.1 1200 lab iDolag et al.l l2009h used to find 
gravitationally bound physical substructures in the groups. 
It first identifies the local overdensities using the SPH ker- 
nel interpolation, then the gravitationally unbound particles 
are iteratively removed. A substructure is considered physi- 
cally bound if the final clumps have more than 20 particles. 
Throughout this work, a galaxy is defined as the group re- 
turned by the SUBFIND, which includes a DM halo, gas, 
stars, and BHs. 

2.2. Entropy Formulation 

We calculate the entropy of different energy forms of the 
Universe as follows: for gas and stars , we use the Sakur- 
Tetro de law dBasu & Lvnden-Bell 1990; Egan & Lineweaverl 
I20l0h . 



Si = kNi MZiiTXlirmikT^e^n^hr 3 ], 



(1) 



where Ni and Z t represent the number of particles and inter- 
nal partition function of either gas or star particles, rti is the 
corresponding particle's number density and other symbols 
in Eq. (Q]) represent their normal physics quantities. For the 
gas particles, we take Z to be 1 for g eneral baryonic mat- 
ter. T his is close to the value used in iBasu & Ly nden-Bell 
(1990), but we treat different types of the baryonic particles 
equally. All other quantities can be extracted from the nu- 
merical simulation. For the star particles, in principle, one 
should use different partition functions for different stellar 
populations. Because of the limitation of the resolution of 
the current cosmological simulation, it is not yet practical to 
trace the evolution of each stellar population directly. So we 
adopt the typical value of a main sequence star and the corre- 
sponding entropy per baryon for all star particles as calculated 



in lBasu & Lynden-Belll (Il990|) . Since there is a simple rela- 
ti on between the entropy per baryon for gas and stars as used 
in lEgan & Lineweaven d201()|) . here we use this relation and 
mass of the stellar component to estimate its entropy from the 
calculated gas entropy in the simulation. 

For the entropy of DM in the Universe, it is worth noting 
that the nature of the DM particles is still unclear. There- 
fore, it is difficult to calculate the DM entropy in an ex- 
act way. In this study, we adopt the cold DM model and 
use a well-motivated de finition from the studies of the X-ray 
clusters in astrophysics (iNavarro et al.lll995l:lEke et al.l 1998: 
iFaltenbacher et al.ll2007|) . That is, we define the "tempera- 
ture" of a DM particle via relation, 



3kT = nm p cF 2 



(2) 



where \i is the mean molecular weight of the DM parti- 
cle, m p is the proton mass and a is the three-dimensional 
velocity dispersion of the DM particle, a can be easily 
extracted from numerical simulation while /i is a parame- 
ter that must be constrained from current investigations of 
the nature of the DM particles. Here, we adopt a typical 
value of 40 GeV for the mass of the DM particles from re- 
cent studies of weakly interacting mass ive particles (WIMP) 
( Geringer-Sameth & Koushiappas 201 1). Now that we have a 
definition of the "temperature" of a DM particle, we can use 
Eq. (Q]) to calculate the entropy of the DM component in a 
way similar to that of the gas component in the simulation. 
We want to emphasize that this method is only to estimate the 
DM entropy from an astrophysics perspective. 

To calculate the entropy of BHs, we use the Be kenstein- 
Hawking formula (BekensteI 3l973l:lHawkinill 19761) . 



Sbh - 



kc 3 A 



(3) 



where A is the surface area of a BH. For simplicity, we 
treat the BHs in the simulation as non-rotating charge-free 
Schwarzschild BHs. So the surface area of the BHs can be 
calculated as A = 16ttG 2 M 2 /c 4 , where M is the BH mass. 
Then the entropy of a BH particle in the simulation can be 
calculated as, 

4ttG 9 

Sbh = k — —M. (4) 

cn 

As we can see from Eq. ©, the BH entropy is proportional 
to the square of its mass. This leads to a BH entropy dominant 
era in the cosmic evolution as we will illustrate in our results. 
But we need to keep in mind that the derivation of the BH 
entropy is not from the same origin as that of gas, star and 
DM. Its exact physical interpretation is still a matter of debate. 

3. RESULTS 

3.1. Formation and Evolution of Cosmic Structures 

Owing to the formation of structures, the Universe evolves 
from a nearly homogeneous distribution of matter to a fila- 
mentary complex, the cosmic webs, with time, as demon- 
strated in Figure [T] Dense regions build up gradually along 
the filaments due to density fluctuation and gravitational insta- 
bility, DM and gas in these regions collapse to form galaxies. 
These galaxies interact with each other and merge hierarchi- 
cally to form ever larger ones. The BHs form in these massive 
halos, and they grow through gas accretion and mergers fol- 
lowing the hierarchical buildup of their host galaxies. At high 
redshifts (z > 10), the gas and DM are the dominant compo- 
nents, but stars and BHs form rapidly at later time (z < 10). 
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Figure 1. Formation and evolution of structures from the cosmological simulation. The images show the 2-D projected density of both gas and stellar components 
in a spatial slice in Z direction with a thickness of 10 Mpc/h (comoving). For the gas and stars, the brightness corresponds to the density while the color 
corresponds to the temperature of the gas (blue indicates cold gas, brown indicates hot, tenuous gas) and the metallicity of the stars (in yellow color). The BHs 
are represented by the black dots, the size of which is proportional to the BH mass. The box size is 100 h~ l Mpc in comoving coordinates. 

The growth history of galaxies and BHs are shown in Fig- 
ure [2] The star formation rate (SFR) rises sharply about 0.5 
Gyrs (z ~ 10) after the Big Bang, it reaches its peak at around 
2 Gyr (z ~ 3), then declines gradually with time. The BH ac- 
cretion lags behind the star formation slightly, but it shares 
similar trend. It increases rapidly to its peak at z ~ 2, after 
that it decreases slowly and maintains a constant rate at late 
time. As a result of such growth, the accumulated mass of the 
galaxies, stars, and BHs increase monotonically with time. 
The BH accretion is about two to three orders of magnitude 
lower than the SFR, which may explain the tight correlation 
between the masses of the SMBHs and the stellar masses of 
their host galaxies, Mbh ~ 10-2- lO^M* observed in nearby 
galaxies (Mag orrian et alJll998UHaring & Rixll2004 . 

Figure [2] clearly shows that the growth of the cosmic struc- 
ture is driven by star formation at early time and BH formation 
at late time.The similarity between the star formation and BH 
growth indicates a co-evolution between galaxies and BHs. 

3.2. Evolution of Cosmic Entropy 

Using the formulation described in Sec. 12.21 we calculate 
the evolution history of the entropy of different energy forms 
in the observable Universe from redshift z = 41 to z = 0. In 
order to calculate the entropy of the whole observable uni- 
verse, we first calculate it using our simulation data with a 
simulation box size of 100 Mpc/h and then scale this result 
up to the size of the ob servable universe wi t h a typical value 
of 14.3 Gpc in radius (IComish et al.1 120041: iKey et al l 120071: 
lEgan & Lineweaverl 120 10: Bielewicz & Banday 2011) using 
the fact that the Universe is very close to uniform on the 
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Figure 2. The growth history of structures from the simulation, as indicated 
by the density of the star formation rate (blue line), the BH accretion rate 
(black line), and their sum (red line) as a function of time. 
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Table 1 

A comparison of different estimates of entropy of different energy 
forms in the present-day observable universe. 
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Figure 3. The evolution history of the entropy of the gas, stars, DM and BHs 
in the Universe. Note the different scales on the left and right axises. The left 
y-axis corresponds to the BH entropy, while the right y-axis corresponds to 
the gas, star and DM entropy. 



scales larger than 100 Mpc/h. The resulting entropy of dif- 
ferent structure components are shown in Figure [3 

For gas (baryonic matter), the entropy only has a very slight 
increase in the redshift range studied except a jump at redshift 
8 < z < 9 because of the cosmic reionization that is imple- 
mented in the simulation. The cosmic entropy at present day 
in this study is , however, about on e magnitude higher than the 
estimation in lEgan & Lineweaven (120101) as shown in Table Q] 
We believe this is caused by the fact that we can calculate 
the te mperature of individual ga s particles in the simulation 
while Egan & Lineweaver ( 2010) only uses the estimation of 
the whole gas component. Thus, our calculation is likely to 
be more accurate than the previous studies. 

For the entropy of the stellar component, since it is cal- 
culated by scaling the entropy of the gas with their relative 
mass ratio, its presen t day value is also higher than the one in 
the previous studies (lEgan & Linewea ver 2010). But, unlike 
the gas component, the stellar component's entropy increases 
dramatically once stars form in the simulation until redshift 
z ~ 2. Then it gradually increases to the present day's value. 
This is due to the rapid cosmic star formation before z ~ 2. 

For the entropy of the DM, th e way we calculate t he en- 
tropy is different from the one in Eg an & Lineweaver] (1201 0|) 
in which the relativistic degrees of freedom is used. So it is 
not straightforward to make a comparison in this case. Simi- 
lar to the gas entropy, the DM entropy also increases slightly 
during the structure formation process. 

For the entropy of the BHs, due to the limitation of the res- 
olution of the simulation, we can only include the BHs with 
masses larger than 10 5 h _1 M . So the BH entropy value 
we calcula te in this study corresponds to the entropy of the 
SMBHs in lEgan & Lineweaver! (120101) . Taking account that 
there are likely more BHs with masses close to 10 5 M in na- 
ture, the actual value of the BH entropy may be even higher. 

The resulting entropy of BHs is at least more than 20 orders 



Energy form 


Entropy (this study) 


Entropy (previous studies ) a 




[k] 
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BHs 


2.06 x 10 105 


10 106 [1],10 102 [2] 


Gas 


3.60 x 10 83 


10 82 [1] 


Stars 


8.25 x 10 81 


10 81 [1], 10 79 [2] 


CDM 


3.13 x 10 82 


_b 



a ril lEgan&Lrnew eavei (2010), [2] Fram pton et aTN 2009) 
b The way we calculate the entropy is different from the one in 
Egan & Lineweaver ( 2010) in which the relativistic degrees of free- 
dom is used. So it is not straightforward to make a comparison in this 
case. 

of magnitude higher than the other energy forms throughout 
the cosmic time in Figure[3l Therefore, the total entropy of the 
Universe is dominated by that of the BHs. This is consistent 
with conc lusions from previous stud i es for the present-day 
Universe dBasu & Lvnden-Bell 1990; Framp ton et al.l 2009: 
Egan & Lineweaver 2010). 

Table [T] gives a comparison of the different estimates of the 
entropy of different energy forms in the local observable uni- 
verse. It shows that our simulation results are close to those 
from previous studies. 

From Figure[3l we clearly see that the growth of the cosmic 
entropy is not a simple linear curve. It increases rapidly from 
a low-entropy state after the Big Bang until z ~ 2, then transits 
to a slower growth. Unlike the entropies of the stars and gas 
which only shows significant increase at early time but flattens 
at later times, the entropy of the BHs keeps increasing with 
time. This trend is likely to continue in the near future. 

3.3. Structure Formation as Driver of Entropy Growth 

The evolution of entropy in Figure [3] and the structure for- 
mation history in Figure [2] show a strikingly similar trend, as 
both increase rapidly at about the same time. This hints a 
possible link between the two. 

To investigate the link between entropy and structure for- 
mation, we plot the growth rate of entropy as a function of 
time, in comparison with the SFR and BH accretion rate, as 
shown in Figure 01 It clearly shows that the the generation 
of entropy is closely related to the SFR and the BH accretion 
rate over the redshift range studied. This coincidence suggests 
that cosmic entropy growth is driven by structure formation. 

4. CONCLUSION 

We have used a large-scale cosmological simulation to 
study the evolution history of the cosmic entropy along the 
structure formation in the Universe. Our calculations are 
based on well-motivated physical formulations using param- 
eters directly from the simulation. Our estimations of the en- 
tropy of different energy forms in the local observable Uni- 
verse are in broad agreement with previous studies. 

Moreover, by tracking the evolution of entropy of differ- 
ent energy forms, we find that the entropy of BHs is at least 
20 orders of magnitude higher than the other components in- 
cluding gas, stars and DM. Therefore, the cosmic entropy is 
dominated by that of the BHs. Rather than follow a simple 
linear curve, it has roughly two distinctive growth phases: a 
rapid increases phase from a low-entropy state at high redshift 
until z ~ 2, then transits to a slower growth phase. 

Furthermore, we find a strikingly similar evolution between 
the growth rate of entropy and that of galaxies. This suggests 
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Figure 4. The evolution history of the entropy growth rate of BHs (black 
solid line), stars (blue solid line), and their sum (red dashed line), contrasted 
by the star formation rate (blue dashed line) and BH accretion rate (black 
dashed line). Note the difference in the y-axises. The left y-axis corresponds 
to the entropy growth rate, while the right y-axis corresponds to the struc- 
ture growth rates. The shaded region indicates the period during which the 
entropy and structure grow rapidly and simultaneously. 

that the cosmic entropy co-evolves with cosmic structures, 
and that generation of cosmic entropy is driven by structure 
formation in the Universe. We predict that the BH entropy, 
and hence the cosmic entropy, will continue to increase in the 
near future at a constant rate. 

We note that due to the limitation of the resolution of the 
simulation, we can only include the BHs with masses larger 
than 10 5 h _1 M0. Taking into account smaller BHs may in- 
crease the actual value of the BH entropy. In addition, due 
to the unknown nature of DM, our calculation of its entropy 
may be subject to a large uncertainty. Nevertheless, these un- 
certainties would not affect our conclusion that the structure 
formation is the main driving force in the generation and evo- 
lution of the cosmic entropy. 
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